Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Remote sensing image classification based on sample incremental learning
Xue LI, Guangle YAO, Honghui WANG, Jun LI, Haoran ZHOU, Shaoze YE
Journal of Computer Applications    2024, 44 (3): 732-736.   DOI: 10.11772/j.issn.1001-9081.2023030366
Abstract244)   HTML10)    PDF (1266KB)(155)       Save

Deep learning models have achieved remarkable results in remote sensing image classification. With the continuous collection of new remote sensing images, when the remote sensing image classification models based on deep learning train new data to learn new knowledge, their recognition performance of old data will decline, that is, old knowledge forgetting. In order to help remote sensing image classification model consolidate old knowledge and learn new knowledge, a remote sensing image classification model based on sample incremental learning, namely ICLKM (Incremental Collaborative Learning Knowledge Model) was proposed. The model consisted of two knowledge networks. The first network mitigated knowledge forgetting by retaining the output of the old model through knowledge distillation. The second network took the output of new data as the learning objective of the first network and effectively learned new knowledge by maintaining the consistency of the dual network models. Finally, two networks learned together to generate more accurate model through knowledge collaboration strategy. Experimental results on two remote sensing datasets NWPU-RESISC45 and AID show that, ICLKM has the accuracy improved by 3.53 and 6.70 percentage points respectively compared with FT (Fine-Tuning) method. It can be seen that ICLKM can effectively solve the knowledge forgetting problem of remote sensing image classification and continuously improve the recognition accuracy of known remote sensing images.

Table and Figures | Reference | Related Articles | Metrics
Single image de-raining algorithm based on semi-supervised learning
Yongru QIU, Guangle YAO, Jie FENG, Haoyu CUI
Journal of Computer Applications    2022, 42 (5): 1577-1582.   DOI: 10.11772/j.issn.1001-9081.2021030492
Abstract321)   HTML17)    PDF (3937KB)(103)       Save

The images collected in rainy days usually have some phenomena that affect the image quality, such as the background object blocked by rain streaks and the image deformation, which have serious impact on the subsequent image analysis and application. Recently, numerous de-raining algorithms based on deep learning have been proposed and achieve good results. Most algorithms adopt supervised learning, that is, training the model on the synthetic rainy image dataset with paired labels due to the difficulty in acquiring clean background images without rain streaks from real-world rainy images. However, there are differences between synthetic and real-world rainy images on brightness, transparency, and shape of rain streaks. Thus, most de-raining algorithms based on supervised learning have poor generalization ability to real-world rainy images. Therefore, in order to improve the rain removal effect of de-raining models on the real-world rainy images, a single image de-raining algorithm based on semi-supervised learning was proposed. In the model training process of the proposed algorithm, the synthetic and real-world rainy images were added, and the difference of the first-order and second-order statistic information of feature vectors converted from the both input images were minimized to make the features of the both have same distribution. Meanwhile, in view of the complex and diverse characteristics of rain streaks, a multi-scale network was introduced to obtain richer image features and improve the performance of model. Experimental results show that, on the Rain100H dataset of synthetic rainy images, compared with Joint Deraining Network (JDNet), Synthetic-to-Real transfer learning (Syn2Real), the proposed algorithm improves the Peak Signal-to-Noise Ratio (PSNR) and Structural SIMilarity (SSIM) by at least 0.66 dB and 0.01 respectively. While removing rain streaks, the proposed algorithm can retain image details and color information to the greatest extent. At the same time, with the reduction of distribution discrepancy, the proposed algorithm achieves better performance on the real-world rainy images with strong generalization ability, compared with the de-raining algorithms such as JDNet and Syn2Real. The proposed algorithm is highly independent, can be applied to the existing de-raining algorithms based on supervised learning and significantly improve their de-raining effects.

Table and Figures | Reference | Related Articles | Metrics